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Five  statistical  tests  are  presented  for  verifying  whether  or  not  the 
failure  rate  is  constant.  Two  tests  are  given  to  determine  if  a constant 
failure  rate  exists.  The  other  three  tests  determine  whether  a constant, 
increasing,  or  decreasing  failure  rate  exists. 

Tables  needed  for  three  of  the  tests  are  included.  Also,  a numerical 
example  is  presented  in  which  three  of  the  tests  are  used  for  comparing 


do 


EDITION  OF  I NOV  *S  IS  OBSOLETE 


SECURITY  CLASSIFICATION  OF  THIS  PACE  (Run  Duo  Bntmod) 


TABLE  Or 


I 

I 

1 


4 

7 

9 

10 

11 

11 


A-  1 
B-l 
C-l 


I.  INTRODUCTION 


One  of  the  objectives  in  the  collection  and  analysis  of  failure  time 
data  on  various  pieces  of  equipment  is  to  determine  whether  the  mean 
time  between  failures  (MTBF)  or  the  mission  reliability  met  a specified 
value  at  a desired  confidence  level.  The  confidence  limits  that  are  to 
be  constructed  on  these  parameters  depend  upon  the  distribution  of  the 
times  between  failures.  In  many  test  programs,  the  times  between 
failures  are  assumed  to  come  from  an  exponential  distribution,  which 
implies  that  an  essentially  constant  failure  rate  exists. 

It  is  the  purpose  of  this  report  to  present  Beveral  statistical  tests 
for  verifying  that  the  failure  times  do  or  do  not  come  from  an 
exponential  distribution.  If  the  analyst  desires  or  finds  it  necessary 
that  such  a test  be  made,  the  type  of  test  he  selects  will  depend  upon 
how  the  data  are  collected,  the  sample  size,  and  the  relative  merits  of 
the  statistical  tests  available 

The  five  tests  presented  are  for  either  small  or  large  sample 
sizes,  and  their  computation  is  simple.  Two  of  the  tests  are  designed 
specifically  to  determine  whether  a constant  failure  rate  exists.  The 
remaining  three  tests  determine  whether  a constant,  increasing,  or 
decreasing  failure  rate  exists. 

Tables  needed  for  three  of  the  tests  are  included  in  Appendix  A. 
Also,  a numerical  example  is  worked  out  in  which  three  of  the  tests 
are  used  for  comparing  results. 
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[ II.  SYMBOLS  USED 

[ 

l Let  0 < < Xj  < ...  < X^  where  X.  is  the  operating 

time  (OT)  at  the  ith  failure.  LetYj,  Y^,  •••  be  the  successive  differ  - 
| rr ces  of  the  X's.  The  Y's  are  then  the  intervals  between  the  failure  time 

! or  the  times  between  failures  (TBF).  In  tabular  form,  we  have: 

■ 

i 

TABLE  A 


i 


1 
1 

2 
3 


N 


X. 

Y. 

D 

1 

l 

i 

X, 

X, 

NX, 

1 

1 

1 

xz 

X2  - X1 

(N  - 

1)  (X2  - Xj) 

x. 

X,  - X> 

(N  - 

2)  (X,  - X,1 

* 

* 

• 

XN 

XN  * XN  - l 

1 * (XN  ' XN  - 1 

i 


i 


t 
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The  D s are  called  the  normalized  times  between  failures,  and  the 
i 

figures  below  show  the  possible  trends  of  the  D/i  obtained  from  data 
(Ref  1). 


Fig.  1.  The  Di's  Fig.  2.  The  Dj's  Fig,  3.  The  D^'s  are 

indicate  an  increasing  indicate  a decreasing  random  (no  trend).  This 

failure  rate.  failure  rate.  implies  a constant 

failure  rate. 

A constant  failure  rate  (CFR),  X , implies  that  the  TBFs  (y) 
come  from  an  exponential  distribution  whose  density  function  is 
Xe  ^ , where  X.  - -g-,  0 being  the  MTBF.  Another  failure  time 
distribution  is  the  Weibull,  whose  density  function  is 

(P/n)  (y/J  - 1 

where  p is  the  shape  parameter  and  h jg  the  scale  parameter. 

If  P = 1.0,  this  density  function  reduces  to  the  exponential. 

A P < 1.0  implies  a decreasing  failure  rate  (DFR),  and  a P > 

1.0  implies  an  increasing  failure  rate  (IFR).  More  will  be  said  about 
the  Weibull  distribution  in  a later  section. 
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CL  v TNDALL'S  RANK  CORRELATION  COEFFICIENT,  OR  THE  TAU 

STATISTIC 

We  want  a statistical  test  to  determine  from  a set  of  data  (the  OT  or 
TBF)  whether  a CFR,  IFR,  or  a DFR  exists.  Graphs  such  as  those 
shown  in  Figures  1 through  3 may  indicate  a definite  trend  or  no  trend  at 
alL  In  any  case,  fluctuations  will  appear  in  such  a graph  which  may  or 
may  not  mask  a significant  trend.  An  analytical  test  is  then  necessary 
for  one  to  come  to  a firmer  conclusion. 

Kendall's  tau  statistic  (Ref  2 and  3)  tests  the  hypothesis  that  the 
average  or  expected  value  of  tau  is  zero.  If  this  hypothesis  of  random- 
ness is  accepted,  we  have  evidence  that  a CFR  exists.  A calculated 
value  of  tau  near  -1.00  indicates  an  IFR;  a calculated  value  of  tau  near 
+ 1.00  indicates  a DFR.  Graphically,  we  have 


IFR 

H 

-1.0 


CFR 

— t- 


DFR 


+ 1.0 


The  formula  for  tau  is 


T 


4k 

N (N  - 1) 


1. 


< T < +1 


(1) 


where  k is  the  number  of  times  a y rank  is  followed  by  a larger  y 
rank.  That  is,  count  the  number  y/ s (the  TBF)  following  that 
exceed  y^  ; then  count  the  number  of  y^'s  following  y^  that  exceed 
y^  . Continue  this  counting  process  through  y^  j , and  add  the 
number  of  such  counts.  This  total  is  k . * (See  Table  A for  the  format 
of  data.  ) 


*For  a computerized  output,  k is  the  number  of  interchanges  in  a 
simple  bubble  sort  ranking. 
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A test  on  tau,  that  is,  a test  on  E (T)  = 0,  is  equivalent  to  a test 
on  the  following  value  of  5^,  calculated  from  the  formula 


/ (2) 


The  value  of  Sjj  could  be  either  positive  or  negative;  hence,  if 
Prob  (S  * Is^l)  ~ y*  where  a is  the  significance  level  of  the  test, 
then  the  hypothesis  that  E (T)  = 0 is  rejected.  Depending  upon 
whether  t is  negative  or  positive,  an  IFR  or  DFR  is  declared  to  exist. 

Table  1,  Appendix  A,  gives  values  of  Prob  (S  - Sj^)  for 
4 ^ N s 10.  If  N > 10,  the  normal  theory  approximation  can  be 
used  for  the  test.  Compute 


z 


2 (2N  4 5) 
N (N  - 1) 


where  z is  the  standard  normal  variable.  If  Prob  (Z  s z)  < r 

when  z < 0,  reject  the  hypothesis  of  a CFR.  If  Prob  {Z  2 z)  £ 1 - a 


when  z > 0 , 
i 

also  reject  this 

•w 

hypothesis. 
TABLE  B 

Di 

' 

i 

18 

18 

126 

2 

33 

15 

90 

3 

52 

19 

95 

4 

59 

7 

28 

5 

62 

3 

9 

6 

67 

5 

10 

7 

68 

1 

1 

3 

1 


I 

I 

i 

1 
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Example:  let 


0.  10 


a 


k=l+l  + 0 + 0+  l + 0 = 3 


T 


J_2 

42 


1 


-0. 714 


S 


7 


6 


42 

2 


-15 


Since  Prob  (S  > | - 1 5 1 ) = 0.015  < | = 0.05  (Table  1),  we  reject 

the  hypothesis  that  a CFR  exists,  and  since  t is  negative,  we  declare 
that  an  IFR  exists.  The  D.'s  in  the  above  table  exhibit  a decreasing 
trend. 
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IV.  THE  PROSCHAN-PYKE  TEST 

An  alternative  test,  using  the  D^'a  above,  is  the  Proschan-Pyke 
test  (Ref  1).  The  sample  size  can  vary  from  3 to  30.  < 

t 

TABLE  C 

~ ' i 

i 


i 

(i  - 1)  DN  + I 

1 

126 

0 

2 

90 

10  - 1 d6 

3 

95 

18  : 2 D5 

4 

28 

84  = 3 D4 

5 

9 

380  = 4 D3 

6 

10 

450  = 5 D, 

7 

1 

756  = 6 D j 

y 

= 359 

Y = 1698 

L 


The  hypothesis  we  are  testing  is  again  that  the  TBFs  are  exponen- 
tially distributed  (a  CFR  exists).  The  alternative  hypothesis  is  that  an 
1FR  exists.  Compute  (for  N = 7) 


i 


i 


N 

2 


(i  - 1)  D 


N - i + 1 


N 


N 

y 


1 


1698 

359 


4.  7 30 


(4) 


7 


In  Table  2 (Appendix  A)  for  N = 7,  o = 0.  10  . the  tabulated 
critical  value  is  3.917.  Since  the  computed  value  of  V ^ exceeds  3.917, 
we  reject  the  hypothesis  of  a CFR  and  accept  the  alternative  hypothesis. 

The  Proschan-Pyke  test  is  also  called  a nonparametric  or  distribu- 
tion free  test.  No  assumption  is  made  about  t’ e distribution  of  the  TBF 
except  that  it  is  continuous.  The  equipment,  when  replaced  on  test  after 
repair,  is  also  assumed  to  be  in  as  good  as  new  condition. 


'--Reference  1 also  gives  a method  for  determining  whether  u DFR  exists 

when  V is  much  less  than  the  tabular  value. 

N 
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V.  THE  W-TEST 


The  previous  tests  required  no  calculation  of  the  MTBF  or  the 
variance  of  the  TBF.  The  following  W-test  *Ref  4)  uses  these  values. 
The  sample  size  is  from  7 to  35. 

Let  s2  i the  sample  variance  of  the  TDF,  and  y = the  calculated 
MTBF.  The  test  statistic  is 


W = 


(N  - l)s 
N 


From  the  data  in  the  sample. 


(N  - 1 )s  - 333.43 


(5) 


and 

(iy  o2 =4624 

i 

Hence,  W = 0.0721.  This  computed  value  is  barely  within  the  interval 
(0.  033,  0.  225).  See  Table  3 (App  A)  for  N = 7,  o s 0.10.  Hence,  it  is 
still  doubtful  whether  a CFR  exists. 

A preliminary  statistic  to  compute  is  the  square  of  the  coefficient 
of  variation  (CV): 

2 

(CV)'^  (6) 

y 

2 2 

If  s /y  ~ 1 . 00,  a CFR  is  suspected. 

?.  —2 

If  s /y  < 1 . 00,  an  IFR  is  suspected. 

Z _Z 

If  s /y  >1.00,  a DFR  is  suspected. 
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In  the  above  example,  s /y  =0.  59.  For  a constant  failure  rate  to 

2 2 , 2 
exist,  a = 9 theoretically.  Here  6 = the  population  MTBF  and  o = the 

population  variance  of  the  times  between  failure. 

VI.  A STATISTICAL  TEST  INVOLVING 
THE  WEIBULL  DISTRIBUTION 


If  a fixed  time  test  is  considered,  that  is,  the  total  operating  time 
of  the  equipment  is  fixed  in  advance  of  testing,  a statistical  test  is 
available  to  determine  whether  p,  the  shape  parameter  of  the  Weibull 
distribution  (Ref  5),  is  one,  less  than  one,  or  greater  than  one.  An 

A 

estimate  of  p,  (3,  is 

a 1 


In  T 


nZ1” 


(7) 


1 


where  T is  the  fixed  time  and  X,  < X.  < X„  < . . . < X - T. 

12  3 N 

The  100  (1  - e)%  confidence  limits  on  |3  are 


UCL  = p 


! X?  c (2N)/2N 
•-  ” 2 


LCL  = P I'xjj  (2N)/2Nn 
L 7 


(8) 

(9) 


where  Xp  (2N)  = the  fractile  value  of  chi-square  at  the  P percent 
probability  level  with  2N  degrees  of  freedom. 

A 

If  these  confidence  limits  span  1.  00  (p,  of  course,  lying  within  this 
interval),  then  a CFR  exists.  If  the  limits  are  less  than  1.00,  a DFR 
exists.  If  the  limits  exceed  1.00,  an  IFR  exists.  This  method  is  attrib- 
uted to  Dr,  Larry  Crow  of  the  US  Army  Materiel  Systems  Analysis 
Activity,  Aberdeen  Proving  Ground,  Maryland  (Ref  5). 


i 


r. 

f 
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VII.  THE  ACCEPTANCE  INTERVAL  TEST 

For  a sample  size  of  seven  or  more,  the  following  acceptance 
interval  test  (Ref  6)  is  useful.  Again,  let  the  operating  times  at  the  ith 
failure  be 


Xi  * X2  , X3  S . 


< X < T 
N 


and  their  sum  be 


N 

x-Ixi 

1 

If  X lies  within  the  interval 


2 


(10) 


(11) 


then  a CFR  is  accepted  with  100(1  - «*)%  probability.  The  factor 

z,  is  the  standard  normal  variable.  For  a = 0.05,  zn  = 1.96. 

I - ^ 0.  9 7 5 

2 

If  a = 0.  10,  z = 1.645.  The  acceptance  interval  is,  therefore, 

7 5 

based  on  a normal  distribution  approximation. 

VIII.  REMARKS 

These  five  statistical  tests  are  but  a few  of  many  to  detci;nine  the 
nature  of  the  failure  rate.  If  a test -to -failure  of  N items  is  conducted 
with  no  repair  or  replacement  of  failed  components,  the  method  of 
matching  moments  test  (Ref  7,  p F-24)  is  used  to  find  estimates  of  the 
Weibull  distribution  parameters  if  the  failure  times  are  Weibull 
distributed.  There  are  also  tests  to  help  determine  if  an  abnormally 
early  or  late  failure  occurred  in  a 1 if e test.  If  the  sample  size  of 
failure  times  is  very  large,  chi-square  tests  are  available. 


1 1 
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L 
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Graphical  tests  to  determine  if  a CFR  is  likely  to  exist  have  been 
excluded,  not  because  they  are  sometimes  inadequate,  but  because 
sharper  analytical  tests  are  available.  The  Kolmogorov 'Smirnov  test 
(K-S  test)  for  a CFR  is  also  excluded  because  it  is  believed  the  W-test 
is  a more  powerful  one,  especially  for  small  sample  sizes. 

All  failure  time  data  are  not  exponentially  distributed.  The  tests 
presented  here  are  useful  techniques  for  helping  the  data  analyst  deter- 
mine whether  or  not  the  assumption  made  on  the  failure-time  distributi  -n 
is  valid. 
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APPENDIX  A.  TABLES 
TABLE  1* 


THE  PROBABILITY  THAT  S 

> C 

' 

4 S N - 

10 

s 

Z 

it 

N = 5 

N = 8 

tz 

n 

>o 

S 

N = 6 

N = 7 

N = 10 

0 

0.  625 

0.592 

0.  548 

0.  540 

1 

0.  500 

0.  500 

0.  500 

2 

0.375 

0.408 

0.452 

0.460 

3 

0.  360 

0.  386 

0.  431 

4 

0.  167 

0.  242 

0.  360 

0.  381 

5 

0.  235 

0.  281 

0.  364 

6 

0.042 

0.  117 

0.  274 

0.306 

7 

0.  136 

0.  191 

0.  300 

8 

0.  042 

0.  199 

0.238 

9 

0.  068 

0.  119 

0.  242 

10 

0.0Z83 

0.  138 

0.  179 

11 

0.  028 

0.  068 

0.  190 

12 

0.089 

0.  130 

13 

0. 0283 

0.035 

0.  146 

14 

0.054 

0.090 

15 

0.  0214 

0.  015 

0.  108 

16 

0.031 

0.060 

17 

0.  0254 

0.  078 

18 

0.016 

0.038 

19 

0.  0214 

0.054 

20 

0.0271 

0.022 

21 

0.  0320 

0.  036 

22 

0. 0228 

0.012 

23 

0.023 

24 

00 

<**> 

o 

• 

o 

0.  0263 

25 

0.  014 

26 

0. 0229 

27 

0. 0283 

28 

0.0Z12 

29 

0.  0246 

31 

0. 0223 

33 

0. 0211 

35 

0. 0347 

I 

d 

A 

\ 


■^Reproduced  from  The  Advanced  Theory  of  Statistics  by  M.  G.  Kendall,  Volume  I,  5th  Edition, 
1952,  by  permission  of  the  publishers,  Charle  s Griffin  & Co.,  Ltd.,  London  & High  Wycombe. 
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TABLE  2* 

CRITICAL  VALUES  FOR  V , 3 < 

N < 30 

N 

a =0.05 

a = 0.  10 

3 

1.684 

1.553 

4 

2.331 

2.  157 

5 

2.  953 

2.753 

6 

3.  565 

3.339 

7 

4.  166 

3.917 

8 

4.759 

4.469 

9 

5.  346 

5.056 

10 

5.927 

5.619 

11 

6.504 

6.  178 

12 

7.077 

6,735 

13 

7.647 

7.289 

14 

8.212 

7.834 

i5 

8.777 

8.385 

16 

9.339 

8.933 

17 

9.899 

9. 480 

18 

10.458 

10.026 

19 

11.015 

10.570 

20 

11.570 

11.  113 

21 

12. 124 

11.655 

22 

12.676 

12.  1% 

23 

13.227 

12.736 

24 

13.777 

13.275 

25 

14. 326 

13.813 

26 

14.  874 

14. 350 

27 

15. 421 

14.  887 

28 

15.967 

15.423 

29 

16. 513 

15.958 

30 

17.057 

16.493 

•'Reproduced  from  Statistical  Inference  Under  Order  Restrictions,  by 
R.  E,  Barlow,  et  ai. , 1972,  with  the  permission  of  John  Wiley  tt  Sons, 
New  York,  through  N = 13.  The  remainder  of  the  table  was  generated 

at  WSMR. 
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TABLES'? 


NINETY  AND  95  PERCENT  INTERVALS  FOR  THE  W-TEST,  7 * N £ 35 


90%  Interval 

95%  Interval 

N 

Lower  Point 

Upper  Point 

Lower  Point 

Upper  Point 

7 

0,033 

0.  225 

0.025 

0.  260 

B 

0.032 

0.  200 

C.  025 

0.  230 

9 

0.031 

0.  177 

0.  025 

0.  205 

10 

0.030 

0.  159 

0.  025 

0.  184 

11 

0.030 

0.  145 

0.  025 

0.  166 

12 

0.029 

0.  134 

0.  025 

0.  153 

13 

0.028 

0.  124 

0.  024 

0.  140 

14 

0.027 

0.  115 

0.  024 

0.  128 

15 

0.026 

0.  106 

0.  024 

0.  119 

16 

0.025 

0.098 

0.  023 

0.  113 

17 

0.024 

0.093 

0.  023 

0.  107 

18 

0.024 

0.087 

0.  022 

0.  101 

19 

0.023 

0.083 

0.  022 

0.  096 

20 

0.023 

0.077 

0.  021 

0.  090 

21 

0.022 

0.074 

0.020 

0.085 

22 

0.022 

0.  069 

0.  020 

0.  080 

23 

0.021 

0.065 

0.  019 

0.  075 

24 

0.021 

0.062 

0.  019 

0.  069 

25 

0.  020 

0.058 

0.  018 

0.065 

26 

0.020 

0.  056 

0.  018 

0.  062 

27 

0.020 

0.  054 

0.  017 

0.  058 

23 

0.019 

0.052 

0.  017 

0.  056 

29 

0.019 

0.  05G 

0.  016 

0.  054 

30 

0.019 

0.  048 

0.  016 

0.  053 

31 

0.018 

0.047 

0.  016 

0.  051 

32 

0.018 

0.  045 

0.  015 

0.  050 

33 

0.018 

0.  044 

0.  015 

0.  048 

34 

0.017 

0.  043 

0.  014 

0.  046 

35 

0.  017 

0.  041 

0.  014 

0.  045 

-Reproduced  from  Statistical  Models  in  Engineering  by  G.  J.  Halm  and  S.  S.  Shapiro,  1967, 
with  the  permission  of  John  Wiley  6 Sona;.  New  York, 
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APPENDIX  B.  THE  WEIEULL  DISTRIBUTION 


I There  ere  numerous  methods  for  obtaining  an  estimate  of  the  shape 

i 

parameter  0.  No  single,  general,  best  estimate  is  available  that 
requires  little  computation.  A least* squares  estimate  requires  a table 
of  median  ranks  and  a double  logarithmic  transformation. 

A 

The  simplest  formula  for  (3  is 

! 

t 

\ £ _ 1.2825 

i “ s (In  y) 


i. 

L 


f* 

f 

[ 

f 


S 

i 

i 

E 


where  s (In  y)  equals  the  standard  deviation  of  the  log -transformed 
times  between  failure,  y.  Tins  is  Menon' a formula,  and  although  it  is 

A 

biased  compared  to  a least-squares  estimate,  the  value  obtained  for  p 
is  still  a good  indicator  of  whether  or  not  p is  close  to  1.00. 

There  is  a special  Weibull  distribution  graph  paper  that  enables 
one  to  plot  the  ranked  TBF  versus  a computed  ordinate  value.  If  these 
plotted  points  cluster  closely  about  a straight  line,  then  the  TBFs  are 
considered  to  be  reasonably  well  Weibull  distributed,  and  an  estimate 
of  p and  rj  (the  scale  parameter)  can  be  obtained.  However,  these 
graphical  values  are  not  very  accurate  because  of  the  subjective  way  in 
which  the  straight  line  is  drawn;  hence,  the  p estimate  is  not 
recommended  if  confidence  limits  on  P are  desired. 
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